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Abstract — Non-data-aided (NDA) parameter estimation is con- 
sidered for binary-phase-shift-keying transmission in an addi- 
tive white Gaussian noise channel. Cramer-Rao lower bounds 
(CRLBs) for signal amplitude, noise variance, channel reliability 
constant and bit-error rate are derived and it is shown how 
- - , these parameters relate to the signal-to-noise ratio (SNR). An 
alternative derivation of the iterative maximum likelihood (ML) 
^~*' SNR estimator is presented together with a novel, low complexity 
NDA SNR estimator. The performance of the proposed estimator 
, is compared to previously suggested estimators and the CRLB. 
Q ,■ The results show that the proposed estimator performs close to 
' the iterative ML estimator at significantly lower computational 
ryy complexity. 
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I. Introduction 
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Most iterative decoders, e.g. turbo decoders [1], rely on 
knowledge of the signal-to-noise ratio (SNR) or the channel 
reliability constant [1-3]. The SNR is also required for other 
functionalities in the receiver. Many SNR estimators have been 
proposed, both data-aided (DA) - that require pilot symbols or 
feedback from the decoders [3-5], and non-data-aided (NDA) 
- that are only based on the received observables [2,4,6]. 

A comparison of both DA and NDA SNR estimators was 
performed in [4] and compared to the Cramer-Rao lower 
bound (CRLB) for DA estimators. The CRLB for NDA esti- 
mators was later derived in [7]. The NDA maximum likelihood 
(ML) estimator based on the expectation maximization (EM) 
algorithm was proposed in [6] and also compared to other 
NDA estimators. This NDA ML estimator was found itera- 
tively, but unfortunately requiring processing of all observables 
for each iteration, making it computationally complex. 

The contributions in this paper are as follows. To com- 
plement the NDA CRLB for SNR in [7], we derive the 
NDA CRLB for the signal amplitude, the noise variance, the 
channel reliability constant, and the bit-error rate (BER). It 
is also shown how to estimate the a priori probability of the 
transmitted symbols, in the case when they are not equally 
likely. Furthermore, we provide a more direct, alternative 
derivation of the NDA ML estimator and we propose a new, 
low complexity NDA SNR estimator. The performance of 
the new estimator is compared to previously suggested NDA 
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estimators and found to be similar to that of the NDA ML 
estimator. This performance is achieved with significantly 
lower computational complexity than the ML estimator. Only 
binary-phase-shift-keying (BPSK) transmission is considered 
here, but generalization to M-PSK is straightforward [4,7]. 

II. Problem Statement 

Let X e {—1,-1-1} denote a binary random variable with 
equally likely symbols. Further, let W represent a zero-mean 
Gaussian random variable with unit variance. Define a new 
random variable Y according to 

Y^fiX + aW, (1) 

with probability density function (PDF) expressed as [6, 7] 
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Let x, y, and w denote samples from X, Y, and W, 
respectively. N independent samples of Y is observed and 
collected in a column vector y = [yi, . . . , j/at] t . If fi = 
y/E^ and a 2 = N /2, the model in Q represents BPSK 
transmission in additive white Gaussian noise (AWGN) 



y = fix + crw, 



(3) 



where y is the matched filter output, x = [x\,X2, ■ ■ ■ , xm\ t 
the transmitted data, and w = \w\, u>2, ■ ■ ■ , wn] t white 
Gaussian noise. E s is the transmitted energy and No] 2 is the 
double-sided noise power spectral density. Define the SNR as 

a E s 

Since all samples in y are assumed independent, the logarithm 
of their joint PDF is given by [7] 
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The average BER can be expressed as 

P( 7 ) 4 Pr(F < 0\X = +l)=Q (y/2j) , (6) 



where Q(a) = 1/V2wf™ e- p2/2 d(3 is the Gaussian Q- 
function. The average mutual information (MI) [8] between 
X and Y in Q can be expressed as 



I( 7 ) ± I(X;Y) = J 

where J is defined as [8] 
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The log-likelihood ratio (LLR) for y n is defined as [8] 

f PY(y n \x n = +D 



A„(A)^ln 



\py(y n \Xn = -1 
where A is the channel reliability constant [1,3] 
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The instantaneous BER for a specific received symbol at 
position n can be estimated by [9] 
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The corresponding instantaneous MI for a symbol at position 
n can be estimated by [10] 

,log 2 (l + e- A "») 
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With no knowledge of the transmitted symbols the average 
BER in (|6jl or the average MI in @ depend solely on the SNR, 
7. Also, in order to use an LLR-based decoder (|9jl (basically 
all turbo-like decoders [1,8] or soft decoders), to estimate the 
instantaneous BER in il 11 1, or to estimate the instantaneous 
MI in d!2i - the channel reliability constant in J10I needs to 
be known. However, as we show in Section ffVl the SNR and 
the channel reliability constant are related through the second 
moment of the observables. We therefore only need to estimate 
one of the two. Here, we have chosen to estimate the SNR, 7. 

III. Cramer-Rao Lower Bound 

The CRLB, here denoted by T, provides a lower bound 
on the variance of any unbiased estimator [11]. Let g(/z,cr) 
represent an arbitrary function of the parameters fi and a, and 
define S = g(fi,a). The normalized CRLB (NCRLB) for S 
can then be calculated as [11] 
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where J is the Fisher information matrix [11], defined as 
J 
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Here E{ } denotes the expectation over Y. A similar Fisher 
information matrix as in (I14t has been derived in [7] and the 
inverse can be expressed as 
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TV 2 - 2/(7) - 87/(7) 
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where /(7) is a function of 7 [7] 
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Using J 1 31 . the CRLB for 7 can be calculated as reported 
in [6] and [7]. The NCRLB s for fi, a, 7, A, and P(~/) are 
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The NCRLB for 1(7) can also be found in a similar way by 
replacing P{ 7 ) in \2\\ with J(^y/Wy). Unfortunately, there is 

no simple form to express Note that J -1 for DA 

estimation is found by setting f(j) = in d!5l > [7]. This 
implies that the NCRLBs for DA estimation of /1, a, 7, A, 
and P(j) are easily found by letting f(j) = in ( I17> - (I21> . 



IV. Estimators 
Define moment k of Y as 
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which can be approximated by its sample average [4]. The 
second moment of Y is 
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Assume that an estimate of 7 exists, denoted by 7. Combining 
(|23 with @ and gives the following estimators for fx, a, 
and A 
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The next sub-sections present different estimators for 7 that 
can be used to estimate the above parameters. 



A. Conventional Method 

The absolute moment (AM) of Y is defined as [2, 12] 

A^E{\Y\} = ^ + a^e'^ -2/xQ(~), (27) 
and can also be approximated by the sample average [4] 
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For large /i or small <r, the AM will tend to \i 

lim A = lim A = /i. 

cr — >0 — >oo 
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In other words, for high values of 7, 7 can be closely 
approximated by 
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using @ and (I23> . This estimator was first introduced in [13] 
and will here be referred to as the conventional method (CM) 
estimate. 

B. Maximum Likelihood 

The ML estimator maximizes the joint PDF in (|5}- Taking 
the partial derivatives of lnpy(y) gives 
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Setting the derivatives in (13 1 1 and (I32> to zero and solve for 



a gives 
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Inserting (I33> in 13 H gives an expression depending only on 
y, jit and M2, which can be solved iteratively by 
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where denotes the estimate of fi after A: iterations. The 
iteration in J34i is identical to the iteration in the EM algorithm 
presented in [6], but here derived in a different way. A good 
starting point for the iterative estimator is the CM estimate of 
fi, /to = A. After K iterations the SNR can be estimated by 
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which will be referred to as the ML estimator. 
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C. Method of Moments 

The approach of estimating a parameter based on the mo- 
ments of the observables is known as the method of moments 
(MM) [11]. The fourth moment of Y is [4] 

Ah = E{y 4 } = /1 4 + 6fi 2 a 2 + 3cr 4 . (36) 

Combining d36l with 1231 gives the MM estimator, e.g. [4], 
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where M 2 and M4 are approximated by the sample average 
(I22> . If M4 > 3M 2 , d37l is no longer real and 7 is set to zero. 
This will be referred to as the MM estimator. 

D. Absolute Moment 

An estimator based on the second moment and the AM can 
be found by combining d23i with J27t . Unfortunately, there is 
no closed-form analytical solution for \i and a as for the MM 
estimator. However, dividing the square of A by M 2 gives an 
expression that only depends on 7, 
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An estimator for 7 can therefore be stated as 

1 \M 2 
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Since there is no closed-form solution to d39i . alternative 
methods must be explored. In [12], a table-lookup for /i -1 (a) 
is suggested. A different approach is to approximate h~ 1 (a) 
with a simple closed-form function, which was done in [2] as, 

h^(a) w Iio(- 34 - 0516 / q2+65 - 9548 / q - 23 - 6184 )/ 10 (40) 

The estimator in d39i . using the approximation in d40l > is 
referred to as the second-order polynomial (P2) estimator. 
From d38i it is easy to verify that 
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h(Q) = - w 0.6366, and ft(oo) = 1. 
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Therefore, we suggest the following approximation of h(a) 
and its inverse 
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Numerical optimization, using the Nelder-Mead simplex 
method [14] to minimize the mean squared difference between 
OH) and g3 gives H x = 0.6153, H 2 = 1.5296, and H 3 = 
—0.6575. The estimator in ( I39> . using the novel approximation 
in d43i . with 7 = whenever A 2 /M 2 < 2/tt, is a new 
approach we propose and is here referred to as the AM 
estimator. 
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Fig. 1. Different approximations of 7 = h^ 1 (A 2 / 'M2) 



Fig. \l\ shows the analytical expression from J38I together 
with its indistinguishable approximation in i42\ . Since the CM 
estimator in J30i depends only on A 2 /M2 it is also shown in 
Fig. It is clear that the function used by the CM estimator 
converges to the analytical one for large 7, but differs for small 
7. The same figure also shows the approximation in J40l >. Since 
this polynomial approximation was only optimized between 
-3 to 3 dB (7 = 0.5-2) [2] it differs from the analytical 
expression outside this region. 

E. Non- Equip rotable Symbols 

Define q to be the a priori probability of X in Q 

q = Pr{X = +1). (44) 

The ML estimator is invariant to non-equiprobable symbols 
and gives the same results even if q = 1 [6], It is straightfor- 
ward to show that A, Mi, and M4 are independent of q [10]. 
Since the CM, the MM, the P2, and the AM estimators are 
based only on these quantities, they will give the same results 
independent of q. 

However, when q 7^ 0.5, the odd moments are non-zero, 
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This means that the a priori probability q can be estimated 
using Mi, by combining ( 145 \ with ® and (I23> 




l + 2 7 



V. 



27M2 2 
Numerical Examples 
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The performance of the SNR estimators is evaluated based 
on their normalized mean squared error (NMSE) 
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and their normalized bias (NB) 
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where 7, is estimated based on N samples. The number of 
trials was chosen to L = 100 000. The best estimator is an 
unbiased estimator with minimum NMSE [11]. 

Fig. shows the NMSE and Fig. shows the NB, both 
for N = 64 observables. The NDA and the DA NCRLB 
are also included as a reference, even though they are only 
bounds for unbiased estimators. All the estimators presented 
here are biased when N — 64, even for high 7 which is evident 
from Fig. [5] Different approaches to reduce the bias has been 
suggested, e.g., [4-6]. The CM estimator has a large NB (and 
therefore also a large NMSE) for low 7. For large 7 the 
CM estimator approaches the ML estimator, which was shown 
analytically in [15]. In fact, Figs.|2H3]show that all estimators, 
except the P2 estimator converges to the same constant NMSE 
and constant NB for high 7 (the NB is around 5% above the 
true 7). The P2 estimator only works well between -3 to 3 dB, 
the interval for which it was optimized. The MM estimator 
has the second highest NMSE for low 7. The ML estimator 
after K = 10 iterations has the lowest NMSE at -6 dB, but 
Fig. [5] shows that it at the same time has the second highest 
NB. Finally, the suggested AM estimator has almost identical 
performance (both in NMSE and NB) as the ML estimator for 
all 7, even though it has a computationally complexity that is 
less than the first ML iteration. 

Figs.EH5]show the NMSE and the NB for different N at -2 
dB. This corresponds to an E^/Nq around 1 dB for a half-rate 
code, e.g. the original turbo code [1]. At this low SNR, the 
CM estimator has bad performance. The NB saturates around 
60% above the true value (not shown here), which gives the 
high NMSE in Fig.@] The P2 estimator has a negative NB for 
large N at this SNR. The ML estimator after 10 iterations and 
the AM estimator have a small positive NB (around 1%) for 
large N . The ML estimator and the MM estimator are the only 
two estimators that are unbiased for large N, but only the ML 
estimator approaches the NCRLB in Fig. |4] which makes it 
asymptotically optimal [11]. The second best estimator, after 
the ML estimator, over the whole range of N is the suggested 
AM estimator. 

VI. Conclusions 

In this paper we have derived the NDA NCRLB for the 
signal amplitude, the noise variance, the channel reliability 
constant, and the BER in an AWGN channel with BPSK mod- 
ulated transmission. It was also shown that these parameters, as 
well as the a priori probability of the transmitted symbols and 
the instantaneous MI can all be estimated based on the SNR 
estimate. A novel SNR estimator with low computationally 
complexity was introduced and shown to be surpassed in 
performance only by the iterative ML estimator among previ- 
ously suggested estimators. The proposed estimator performs 
close to the performance of the iterative ML estimator at 
significantly lower computationally complexity. 
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SNR: 7 = E 3 /No [dB] 
Normalized MSE for 7 when N = 64 samples are observed. 
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Fig. 3. Normalized bias for 7 when N = 64 samples are observed 
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Fig. 4. Normalized MSE for 7 when 7 = —2 dB. 
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